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Abstract 

We consider the Randall-Sundrum extra dimensional model with fields propagating 
in the bulk based on an extended electroweak gauge symmetry with specific fermion 
charges and localizations that allow to explain the LEP anomaly of the forward- 
backward asymmetry for 6-quarks, A b FB . We study the manifestations of the strongly- 
interacting and electroweak gauge boson Kaluza-Klein excitations Vkk at the LHC, 
with masses of the order of a few TeV, which dominantly decays into top and bottom 
quark pairs. We first analyze the two-body tree-level production processes pp — > tt 
and bb in which the Kaluza-Klein (KK) excitations of gauge bosons are exchanged. We 
find that the additional channels can lead to a significant excess of events with respect 
to the Standard Model prediction; characteristic top quark polarization and angular 
asymmetries are quantitatively studied and turn out to probe the chiral structure of 
couplings to excited states. We then analyze higher order production processes for the 
gauge boson excitations which have too weak or no couplings to light quarks and, in 
particular, the loop induced process gg — ► Vkk ti and bb in which the anomalous 
ggVuK four-dimensional vertex has to be regulated. The RS effects in this process, as 
well as in the four-body reactions pp — ► tibb, tttt, bbbb and in the related three-body 
reactions gb — ► btt, bbb, in which the Vkk excitations are mainly radiated off the heavy 
quarks, are shown to be potentially difficult to test at LHC, due to small phase space 
and low parton density for Mkk ^ 3 TeV. 



1. Introduction 



Among the extra-dimensional models which have been proposed in the recent years as ex- 
tensions of the Standard Model (SM), the one of Randall and Sundrum (RS) [1] seems to 
be particularly attractive. First, it addresses the gauge hierarchy problem without intro- 
ducing a new energy scale in the fundamental theory. Moreover, the variant in which the 
SM fermions and gauge bosons are propagating in the bulk allows for the unification of the 
gauge coupling constants at high energies [2] and provides a viable candidate of Kaluza-Klein 
(KK) type for the Dark Matter of the universe [3]. This version of the RS model with bulk 
matter offers also the possibility, through a simple geometrical mechanism, of generating the 
large mass hierarchies prevailing among SM fermions [4-6]. Indeed, if the various fermions 
are placed along the extra dimension, their different wave functions overlap with the Higgs 
boson, which remains confined on the so-called TeV-brane for its mass to be protected, 
generate hierarchical patterns among the effective four-dimensional Yukawa couplings. 

If this extra-dimensional model is to solve the gauge hierarchy problem, the masses of 
the first KK excitations of the SM gauge bosons, Mkk, must be in the vicinity of the TeV 
scale. The direct experimental search for KK gluon excitations at Tevatron Run II leads 
to the bound Mkk ^ 800 GeV [7]. The high-precision measurements impose strong lower 
bounds on Mkk as the exchanges of the KK excitations lead to new and unacceptably large 
contributions to the electroweak observables [8]. Nevertheless, it was shown [9] that if the 
SM gauge symmetry is enhanced to the left-right structure SU(2)l x SU(2)r x U(1)b-l, with 
B and L being respectively the baryon and lepton numbers, the high-precision data can be 
nicely fitted while keeping the masses down to an acceptable valuqj of Mkk — 3 TeV, this 
lower limit being quite independent of the geometry of the extra dimension [11]. 

Instead of the U(1)b-l group in the extended gauge symmetry as originally proposed 
in Ref. [9], other U(l)x groups with different fermion charges can be considered [12,13]. 
An important motivation is that with specific charges of the new Abelian group and for 
specific fermion localizations, different from the ones considered in Ref. [9], the three standard 
discrepancy between the forward-backward asymmetry A b FB in Z decays to bottom quarks 
measured at LEP and elsewhere [14, 15] and the SM prediction [16] is naturally resolved, 
while keeping all the other electroweak precision observables, including the partial decay 
width of the Z boson into 6-quarks Rb = T(Z — > bb)/T(Z — > hadrons), unaffected and in 
agreement with the data. More precisely, in the framework presented in Refs. [12,13], the 
measured values of the asymmetry A b FB (yfs) can be reproduced both at LEP1 [14], i.e. on 
the Z pole, and at energies outside the Z-pole [15], while with the charge assignments of 
U(I)b-L) the measured value of the asymmetry cannot be reproduced at energies lower than 
LEP1; see Ref. [13] for a detailed discussion. 

lr The severe indirect bounds on Mkk from precision data could also be softened down to a few TeV in 
scenarios with branc localized kinetic terms for fermions and gauge bosons [10]. 



2 



The resolution of the A b FB LEP anomaly is essentially due to the fact that since the 
third generation fermions should be localized closer to the TeV-brane to get higher masses, 
their couplings to the KK gauge bosons, which are typically located near the TeV-brane, 
are larger and generate more important contributions to electroweak observables in the b 
sector. One needs also to take into account the tension between generating a large mass to 
the top quark, which requires the left-handed doublet (t, b)i to be near the TeV-brane, and 
satisfying the bounds from precision data that constrain the ZbJ)L coupling to be almost 
SM-like, which forces the (t, b)i doublet [via the mixing of the Z boson with the KK states] 
to have small couplings to the KK gauge bosons and thus to be far from the TeV-brane. 
However, for a suitable choice of the (t, b) l representation under SU(2) R , the KK corrections 
to the coupling ZbJjL can be suppressed [12,17]. Alternatively, the tension is softened in 
the framework of Ref. [13] summarized above, in which the Zb^bi and Zb^b^ couplings are 
chosen so that the electroweak precision data are reproduce^. 

Thus and, generically speaking, in the context of the RS model with SM fields in the 
bulk, the KK gauge bosons dominantly couple to heavy SM fermions as they are localized 
toward the TeV-brane (this typical feature can only be avoided in some particular situations 
[21]). In this case, the processes involving the third generation b and t quarks are those 
which are expected to be significantly affected by the presence of the new vector states. In 
Ref. [13,22], the impact of the KK excitations of the electroweak gauge bosons has been 
discussed in the context of heavy flavor production at high energy e + e~ colliders (ILC). 
Because of the high precision which can be achieved in the measurement of the production 
rates and polarization/angular asymmetries in the e + e~ — > ti,bb processes at the ILC, KK 
vector excitations with large masses can be probed, provided that they have non-vanishing 
couplings also to the initial light leptons. However, because of the limited energy of the ILC, 
s/s = 0.5-1 TeV, and the expected large Vkk masses, M KK ~ a few TeV, the particles are 
accessible only indirectly through their virtual exchange. 

At the Large Hadron Collider (LHC), the energy is principle sufficient to produce directly 
the KK excitations of the gluons and the electroweak gauge bosons with masses in the multi- 
TeV range. The most direct manifestation of these KK stated would be their production 
in the Drell-Yan processes, pp — > Vkk = <7 , 7 , Z^\ Z' 1 '. However, in contrast to the 
(standard) production at the LHC of extra Z' bosons from Grand Unified Theories (GUTs) 
[25] and to some universal extra-dimensional models [260, there are many difficulties in the 

2 Note that there are also constraints on the top and bottom quark couplings from Flavour Changing 
Neutral Current (FCNC) processes, but those can be satisfied for Mkk values around the TeV scale Ref. [18- 
20]. 

3 Another possibility to probe this variant of the RS scenario at LHC is to look for the production of KK 
gravitons [23], or, the new quarks that are present in the model [24]. In the present analysis, we do not 
discuss these possibilities and we assume that the new fermionic states are too heavy and do not end up as 
decay products of the KK gauge bosons. 

4 In Ref. [26], this mechanism has been studied at the LHC in RS models with bulk matter but with 



3 



present scenario. The first one is that, contrary to the new Z's of GUTs, the KK excitations 
present in this model have rather tiny couplings to the light fermions and large couplings to 
the heavy quarks. On the one hand, the production cross sections in the Dreli-Yan process 
qq — > Vkk are much smaller, the probability of finding a heavy quark in the proton being 
tiny; in fact, in the case of the excitations of the extra Z', which is a superposition of the 
Z R and Z x bosons of the extended SU(2) R x U(l)x group, the couplings to light fermions 
are almost negligible and Drell-Yan production does not occur [except through bb — > Z ^ 
which gives a small contribution due to the reduced 6-quark density in the proton]. On 
the other hand, because of their large couplings to heavy fermions, the new KK excitations 
will decay almost exclusively into ti and bb final states; these topologies have a less striking 
signature than the GUTS Z 1 — > £ + £ with £ — e, fi channel and are subject to a much more 
severe background at the LHC Another difficulty, that is related to the previous one, lies 
in the fact that because of the strong couplings to heavy fermions, the KK excitations have 
large total decay widths and are not anymore narrow resonances. This will complicate the 
searches for these states since in the processes pp — > Vkk —> ti or bb, the corresponding QCD 
backgrounds become also large as they have to be integrated in wider bins [28,29]. 

There are two other possibilities of observing the heavy KK states. The first one is 
single Vkk production in the gluon-gluon fusion mechanism gg — > Vkk which is mediated 



four-dimensional effective couplings, the one-loop effective ggViK vertex is anomalous and 
the chiral anomaly has to be regulated by considering the Stiickelberg mixing term (for a 
review on the topic, see e.g. Ref. [30]). The second possibility is associated production 
with heavy quark pairs, pp —> gg/qq — > QQVkk with Q = t,b, leading to bbti, bbbb and titi 
final states; another mechanism, which is related to the later class of processes would be 
the two-body process gb — > b Vkk —* bbb,bti where the initial bottom parton is taken from 
the proton sea|j. In fact, when the couplings of the KK states to light quarks are small and 
the Drell-Yan process is not effective, these mechanisms are the only possibilities which give 
access to the new states; this is the case for the production of the KK excitation of the new 
Z' boson for instance. However, because these processes are of higher order in perturbation 
theory, the production cross sections are not substantial despite the fact that the couplings 
which are involved are large. Nevertheless, in view of the interesting final state signature, a 
better control of the corresponding QCD backgrounds might be possible. 

the hypothesis of a universal fermion profile [made in order to totally suppress FCNC effects] which are not 
compatible with an interpretation of fermion mass hierarchies through the wave function overlap mechanism. 

5 The process 1717 — > Vkk — ► ti has been first suggested in Ref. [9] and recently mentioned in Ref. [27]; 
however, because of Yang's theorem the vector part of the ggVuK coupling will give zero contribution while 
the axial part of the coupling will give a finite contribution only if the Vkk state is virtual and, thus, if its 
total width is included. 

6 This second class of processes have also been discussed in Ref. [31] for rather general scalar and vector 
resonances which couple to top and bottom quarks with the same strength. 




because of the chirality dependence of VkkH and Vkk^ 
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In the present paper, we perform a complete study of the Drell-Yan and gluon fusion 
processes qq, gg — * bb, ti as well as the associated production qq/ gg — > bbti, bbbb, titi and 
gb — > bbb, bti processes at the LHC, in the RS model with bulk matter. We will base our 
analysis on the framework which resolves the A b FB anomaly [13], but the results that we 
obtain can be easily generalized to other scenarios. In a parton-level analysis which includes 
only the dominant QCD backgrounds, we show that for a set of characteristic points of the 
parameter space, the exchange of KK gauge bosons [excitations of the gluon as well as of 
the electroweak bosons 7, Z and new Z'\ can lead to visible deviations with respect to the 
SM production rates in the Drell-Yan process pp — > Vkk bb, ti. For the latter reaction, 
the signal rates are large and some top polarization and asymmetries allow to test the chiral 
couplings to the KK modes. In the case where the KK excitations have too small couplings 
to the light quarks, the loop induced gluon fusion mechanism gg — > ti and bb as well as the 
associated production mechanisms pp — > QQVkk bbti and gb — > bti, with an excess in 
the top or bottom pair invariant mass distributions can be in principle exploited. However, 
because of the large mass of the KK excitations assumed in this study, the signal significance 
turns out to be small, except potentially, for the gb — > bti process. 

Note that while the present analysis was on-going, the on-shell production of KK gluons 
decaying into top quarks, pp — > — > ti has been studied at the LHC [27, 28] in the 
framework developed in Ref. [9] with the left-right extended gauge structure. The pp — > bb 
process has not been considered as it is expected to be less significant than in the framework 
[13] considered here where the right-handed b quark is closer to the TeV-brane, with an 
increased coupling to KK gauge bosons; also in this case, the cross section for ti production 
would be different as b coupling variations modify e.g. the KK gluon total width as well as 
the bb parton initial state contribution (especially as here 6r is closer to the TeV-brane so 
that it can get a non-vanishing coupling to the Z'). Note also that the production of the 
excitations of the electroweak gauge bosons as well as higher order processes (including 3 and 
4 quark final states) have not been considered in Ref. [27, 28] (in [27] the emphasis was put 
on the determination of excitation spin and methods of highly energetic top identification). 

The paper is organized as follows. In the next section, we briefly describe the theoretical 
framework in which we will work and the considered scenarios which will be used for illus- 
tration; the decays of the KK states will also be summarized. In section 3, the signal of the 
KK excitations at the LHC in the Drell-Yan processes pp — > ti, bb and the corresponding 
irreducible QCD backgrounds are analyzed; relevant polarization and angular asymmetries 
are studied in details. In section 4, we discuss the gluon fusion mechanism gg —> Vkk — > ti, bb 
and briefly the associated production processes with ti/bb pairs and those with a 6-quark, as 
well as their corresponding QCD backgrounds. A brief conclusion will be given in section 5. 
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2. Physical framework 
2.1 The specific RS extension 

In this paper, we consider the RS model in which SM fields propagate along the extra spatial 
dimension, like gravity, but the Higgs boson remains confined on the TeV-brane. In the RS 
scenario, the warped extra dimension is compactified over a S 1 /^ orbifold. While the gravity 
scale on the Planck-brane is Mp = 2.44 x 10 18 GeV, the effective scale on the TeV-brane, 
M* = e~ nkRc Mp, is suppressed by a warp factor which depends on the curvature radius of 
the anti-de Sitter space 1/k and the compactification radius R c . The product kR c ~ 11 
leads to M i , = 0(l) TeV, thus addressing the gauge hierarchy problem. 

The fermion mass values are dictated by their wave function localization. In order to 
control these localizations, the five-dimensional fermion fields with % = 1,2,3 being 
the generation index, are usually coupled to distinct masses in the fundamental theory. 
If rrii = sign(y)cj/c, where y parameterizes the fifth dimension and c$ are dimensionless 
parameters, the fields decompose as ^i{x^,y) = Yl^a^t^i^) fniv) ■> where n labels the 
tower of KK excitations and f^(y) = e^^^/N^ with Nq being a normalization factor. 
Hence, as Cj increases, the wave function fv(y) tends to approach the Planck-brane at y — 0. 

In order to protect the electroweak observables against large deviations and, at the same 
time, to resolve the anomaly in the forward-backward asymmetry for 6-quark production 
A b FB , the electroweak gauge symmetry is enhanced to SU(2) L x SU(2) R x U(l)x with the 
following fermion representations/charges under the group gauge [12,13]: 

Q\ = (2,l)i; <G(l,2)i with i& = +±; 

4e(l,2)_ f with/ 3 d | = +i 

Li = (2,l)_i; 4e(l,2)_i with4 = -^ (1) 

respectively for the left-handed SU(2)l doublets of quarks, right-handed up/down type 
quarks, doublets of leptons and right-handed charged leptons. The usual symmetry of the 
SM is recovered after the breaking of both SU(2)r and U(l)x on the Planck-brane, with 
possibly a small breaking of the SU(2)r group in the bulk. Note the appearance of a new 
Z 1 boson [but without a zero-mode] which is a superposition of the state W 3 associated 
to the SU(2) R group and B associated to the U(l)x factor; the orthogonal state is the SM 
hypercharge B boson. Up-type quarks acquire masses through a Yukawa interaction of type 
(2,l)i(2,2)o(l,2)i, the Higgs boson being embedded in a bidoublet of SU(2) L x SU(2) R . 

6 6 

Because of their specific SU(2) R isospin assignment / 3 jj, down-type quarks become massive 
via another kind of invariant operator as in Ref. [12, 13]. 
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2.2 EW constraints and the fermion couplings 



From the theoretical point of view, solving the gauge hierarchy problem forces the masses of 
the first KK excitations of the SM gauge bosons, M KK = M_,(i) = M g a) — M z a) — M z >a), to 
be of order the TeV scale. Indeed, one has M KK = 2AhkM iK /M P <M i = C(TeV) since the 
theoretical consistency bound on the five-dimensional curvature scalar leads to k < 0.105Mp. 
More precisely, the maximal value of Mkk is fixed by this theoretical consistency bound and 
the kR c value. One could consider a maximal value of Mkk — 10 TeV which corresponds to 
kR c = 10.11. From the experimental point of view, as mentioned previously, the electroweak 
(EW) high-precision data force the KK mass to be larger than Mkk ~ 3 TeV. Given these 
theoretical and experimental considerations, we will fix the masses of the KK excitations to 
a common value Mkk = 3 TeV in the present study. 

With light SM fermions [leptons and first/second generation quarks] characterized by 
cnght > 0.5, c being the parameter which determines the fermion localization as discussed in 
the subsection above, the bulk custodial isospin gauge symmetry insures an acceptable fit of 
the oblique corrections to electroweak observables for M K k > 3 TeV [9]. The large value of 
the top quark mass requires c tR < 0.5 and c Q 3 < 0.5, with c Q 3 = c tL =Cf, L [as the states bi and 
t L belong to the same SU(2) L multiplet] so that the top and bottom quarks have to be treated 
separately in the studies of the electroweak precision data. In the framework developed in 
Ref. [13], the precision data in the b sector, that is, the 6-quark forward-backward asymmetry 
A b FB and the bb partial decay width of the Z boson Ri, = YiZ — > bb)/T(Z — > hadrons), are 
correctly reproduced with Mkk = 3 TeV for certain values of the c parameters depending 
on the coupling constant g z > of the new Z' boson. 

For instance, if the coupling gz> is equal to 0.6\/47r, the best fit of the observables Rf, 
measured at LEP1 and A b FB (s/s) measured at various center-of-mass energies is obtained 
for Cq3 ~ 0.36 and Cb R — 0.438 [the fit corresponds to Xrs — 14 an d substantially improves 
the one in the SM, Xsm — 24]. For this Cb R value, one obtains the values Q(cb R ) — 0.55 
and Q'(cb R ) ~ 0.75, where Q(c) (Q'(c)) is the ratio of the four-dimensional effective cou- 
pling between the /yW /Z^ (Z'^) boson and the SM fermions, over the coupling of 
the gluon/photon/Z (would be Z') boson zero-mode. In fact, the value chosen above for 
the gz' coupling is close to the typical limit obtained from the perturbativity condition, 
2irkR c g 2 z , / IQn 2 < 1, for the coupling of the KK excitation of the Z' boson, when quantum 
corrections are included. Indeed, the effective four- dimensional coupling of the Z'^ boson 



to SM fields is increased by a factor as large as J2-nkR c relatively to g z > for SM fields near 
the TeV-brane, like for example the Higgs boson_|. 

For the choice gz> = 0.3a/47t, the best fit of R;, and A b FB (y/s) [still corresponding to a 

7 A bound of the same order can be derived from considerations on the strong coupling regime of the five- 
dimensional theory: perturbativity imposes that the five-dimensional loop expansion parameter, estimated 
at an energy k to be ~ (g|P) 2 fc/167r 2 = 7rfci? c g|,/167r 2 , should be smaller than unity [32]. 
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good fit of the data, \ 2 — 14] is obtained for the c values Cq3 ~ 0.36 and Cb R ~ 0.135, 
leading to the charges Q(cb R ) — 3.0 and Q'(cb R ) — 3.2. For this value of Cq3 , one obtains for 
instance a top quark mass m t ~ 90 GeV or m t ~ 80 GeV with, respectively, Ct R — —0.3 or 
c tR — +0.1, which are in the correct order of magnitude. In order to determine the set of 
parameters that would reproduce exactly the measured m t value, one need to study the full 
three-flavour mass matrix [by fixing also each Yukawa coupling constant] and include the 
effect of mixing between t and its KK excitations, which is beyond the scope of this work. 
For Cq3 ~ 0.36 and Cb R ~ 0.438, the bottom mass has also a correct order of magnitude. 
The bottom and top quark Yukawa couplings have different gauge structures in the present 
context and the bottom Yukawa coupling constant could be taken smaller (while choosing 
a smaller Cb R , in order to still generate a satisfactory bottom mass) as proposed in Ref. [12] 
in order to have a weak breaking of the custodial symmetry subgroup protecting the Zb]J)L 
coupling. 

In this study, we will consider four typical scenarios which are defined by the c assignments 
for the top and bottom quarks and the value of the coupling gz>] these parameters and their 
corresponding Q(c) and Q'(c) charges are summarized in Table 1. In the four points of 
parameter space, labeled £1,2,3,4, the assignment for the left-handed (t, b) doublet, Cq3 = 0.36 
which leads to the charges Q(cqs) = 1.34 and Q'(cq3 ) = 1.52, has been adopted in order to 
reproduce the experimental values of A b FB and Rb- For the light fermions, i.e. the leptons 
and the first and second generation quarks, we will set ci ig ht > 0.5, as necessary to generate 
sufficiently small masses. This leads to a small Q charge for these fermions, Q(cii g ht) — —0.2, 
and a zero Z' charge, Q'(cii g ht) = 0. This means that the couplings of the KK excitations of 
the gluon, photon and Z boson have small couplings to light fermions compared to the top 
and bottom quarks [an order of magnitude smaller in general], while the KK excitations of 
the Z' boson do not couple to these light fermions at all. 





gz> 


c b R 


Q(c bR ) 


Q'(c bR ) 


c t R 


Q(c tR ) 


Q'(c tR ) 


Ex 




0.438 


0.55 


0.75 


-0.3 


4.90 


5.01 


E 2 


O.Sv 7 ^ 


0.135 


3.04 


3.19 


-0.3 


4.90 


5.01 


E 3 




0.438 


0.55 


0.75 


+0.1 


3.25 


3.40 


£4 


O.Sv 7 ^ 


0.135 


3.04 


3.19 


+0.1 


3.25 


3.40 



Table 1: The four scenarios labeled -Ei,...,4 to be considered in this study and their respective 
c assignments, Q(c),Q'(c) charges and gz> couplings. The other (common) parameters are 
Cq3 = 0.36, which leads to Q(cqz) = 1.34 and Q\cqa) = 1.52), and ciight > 0.5, for which 
flight) = -0.2 and Q'(ciight) = 0; M KK = 3 TeV. 
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2.3 Decays of the KK gauge bosons 



The KK excitations of the gauge bosons will decay into pairs of SM fermions, Vkk ff] 
as mentioned previously, we will assume that all the KK excitations of the fermions, as 
well as the zero-modes of the new fermions that are present in the model, are too heavy, 
2m/ > My KK , so that they do not appear in the decays of the KK gauge bosons. The partial 
decay width of Vkk into a fermion species / is given by 



r(v KK -> //) 



m Vk 



24vr 



^(( 9 jr) 2 +( 9 ;r> 2 ) + 



Vkk Vkk 
9f L 9fn 



(2) 



where rrif is the mass of the fermion /, /3f = y 1 — 4m 2 j-/My KK its velocity in the rest frame 
of the KK gauge boson and Cj KK the color factor: C^ KK = 3, CY KK = 1 for electroweak boson 



couplings to, respectively, quarks and leptons and Cf 1} = h cf — for the coupling of 



the KK gluon to quarks and colorless fermions. The left- and right-handed couplings of 
the KK gauge boson Vkk to the fermion / are denoted by gJ^ K and gj^', in terms of the 



couplings of the corresponding zero-mode, gY , they are given by gY KK = gY Q^'Hct 

J L I Ft J L / Ft J L / Ft " ' 



TL/RJ 



with Q(cj L/R ) and Q'(cf L/R ) as defined in the previous subsection and given in Table [TJ The 
total decay width of the KK excitation is simply IV KK = ^2 . r(VkK — > ff), where the sum 
runs over all SM fermions. 

Because the KK gauge boson couplings to fermions are directly proportional to the 
charges Q{c) and Q'(c), the partial decay widths r(Vk K -> //) oc (gJ* K ) 2 + (gJ R K ) 2 in 
the limit My KK 3> rrif, are typically two orders of magnitude larger in the case of final state 
top and bottom quarks than for the light fermions. The branching ratios BR(Vkk - * tt) 
and BR(Vk K -> 66), with Vkk = 7 (1) , and g^\ are displayed in Table 2 in the 

four scenarios -Ea,..,4 introduced previously. As can be seen, the sum of these two branching 
ratios is close to unity which means that the KK excitations decay almost exclusively into 
the heavy t, b quarks and that little room is left for decays into light quarks and leptons [in 
fact, there is no room at all for these decays in the case of the Z'^ boson as the charge 
Q'( c iight) is zero]. In our analysis, we will therefore concentrate on the t,b final state decay 
products of the KK gauge bosons. 

Finally, the total decay widths of the KK excitations Vkk are also given in Table 2 for 
the four scenarios. As they grow proportionally to the mass My KK , they are rather large 
for the value Mkk = 3 TeV. For instance, the decay width of the KK gluon is of the order 
of a few hundred GeV and is between 10% and 20% of the g^ mass; the KK state can be 
thus considered as a relatively narrow resonance. Due to the significant gz> values taken, 
the total decay widths are smaller for the KK excitations of the photon and Z boson than 
for the KK excitation of the Z' boson. In the latter case, the total width is comparable to 
the Z'^ mass and one can hardly consider the state as a true resonance. 
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9 {1) 


7 (i) 


z m 


Z'O) 




627/0.08/0.91 


137/0.02/0.96 


75/0.28/0.68 


3360/0.02/0.98 


E 2 


828/0.30/0.69 


149/0.10/0.89 


79/0.31/0.65 


1080/0.29/0.71 


E 3 


328/0.14/0.83 


68.0/0.04/0.93 


54/0.39/0.56 


1580/0.04/0.96 


E, 


530/0.47/0.52 


80.0/0.18/0.79 


58/0.43/0.53 


661.0/0.47/0.53 



Table 2: The total decay widths (in GeV) and the bb and tt branching ratios of the first KK 
excitations of the gluon, photon, Z and Z' bosons in the four selected scenarios E\, .., E 4 for 
M KK = 3 TeV: IV kk /BR(Vkk -> bb)/BR(V KK -> tt). 

3. Top and bottom quark pair production 

3.1 General features 

The most straightforward way to produce the KK excitations of the gauge bosons^ Vkk at 
the LHC is via the Drell-Yan process, 

pp -> qq -> Vkk -> QQ , Q = t,b (3) 

with the gauge bosons Vkk subsequently decaying into top and bottom quarks; Fig. la. 
As discussed previously, Vkk decays into the light fermion states [leptons and first/second 
generation quarks] will be neglected as their branching ratios are very small in the framework 
that we are considering here. The relatively small couplings of the initial quarks q = u,d,s,c 
to Vkk lead to smaller production rates compared to, for instance, the production of Z' 
bosons from GUTs which have full-strength couplings to light fermions. Because the Vkk 
couplings to bottom quarks are large, the partonic cross section from the subprocess bb — > 
Vkk would, in principle, be more substantial than for the qq — > Vkk subprocesses but, 
after folding with the smaller 6-parton density, the corresponding hadronic cross section 
is reduced. Note that since the KK gauge bosons have different couplings to left- and 
right-handed fermions, one expects the produced t/b quarks to be polarized and to have a 
forward-backward asymmetry. 

Because the KK excitations have substantial total decay widths [see Table 2], the nar- 
row width approximation in which the production and decay processes are factorized and 
considered separately is not sufficient. Indeed, one needs to consider the virtual exchange 
of the KK excitations in which the total width is included in a Breit-Wigner form, together 
with the exchange of the zero modes. The full interference between the zero and first modes 
of the gluon, on the one hand, and of the electroweak bosons, on the other hand, should 
be taken into account [because of color conservation, there is no interference between the 

8 From now on, we will restrict ourselves to the first KK excitations, Vkk = 7 j Z'^ and 
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Figure 1: Feynman diagram for heavy Q = t,b quark pair production at the LHC through 
qq annihilation, where q stands for initial state quarks and KK for the KK excitations of 
neutral gauge bosons, namely j^ n \ g^ n \ Z^ and Z'^ with n = 0, 1, 2, . . . being the KK level; 
mainly the zero-modes n = 0, except for Z' , and the first KK excitations n = 1 contribute to 
the signal. For bottom quark production there is an additional t-channel diagram exchanging 
neutral KK gauge bosons with bottom partons in the initial state (b). 

amplitudes in which the gluon and the electroweak gauge bosons are exchanged]. For the 
bb production, the subprocesses are also initiated by bottom partons and one should also 
consider the channel in which the KK gauge bosons are exchanged in the t-channel; Fig. lb. 

The signal for the KK gauge bosons qq — > Vkk QQ and the main SM background 
qq — > QQ and gg — > QQ have to be considered simultaneously. For the signal reaction, we 
have calculated the matrix element squared of the process pp — > QQ with polarized final state 
quarks and incorporated the exchange, including the t-channel contributions, of all the SM 
gauge bosons as well as their KK excitations and those of the Z' boson. For the background 
processes, the contributions of both the qq and gg initial states have been calculated and the 
exchange of the KK excitations of the gauge bosons were switched off. To obtain the cross 
sections a at the hadronic level, we use the CTEQ5M1 set of parton distributions [34] with 
the factorization and a renormalization scales set to the invariant mass of the QQ system, 

fiF = VR = m QQ/ 2 - 

The significance S of the signal in the RS model can be then defined as 

RS+SM _ SM 

S c = == x y/C, (4) 

V ^SM V > 

where L denotes the total integrated LHC luminosity. In our analysis, we will chose two 
examples for the luminosity: a lower value C = 10 fb~ x that is expected in the first years of 
the LHC running and a high value C = 100 fb^ 1 which is expected to be reached after a few 
years of running. 

In order to enhance the signal, which is peaked at the invariant mass of the QQ system 
(as will shown in details later), and to suppress the continuum background, one needs to 
select events near the KK resonance. Throughout this analysis, we impose a cut on the 
invariant mass of the QQ final state 

I m Q Q -Mkk I < T^kk (5) 
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To further reduce the backgrounds, we also impose the following cuts on the transverse 
momenta of the two final jets and their rapidity 

pf Q > 200 GeV , |t/ Qi q| < 2 (6) 

as in the signal, the px of the jets is peaked close to §My KK and the production is central, 
while in the background, the jets are peaked in the forward and backward directions and 
the bulk of the cross section is for low jets. These cuts can certainly be improved 
to optimize the signal to background ratio but we will refrain from performing such an 
optimization here. In fact, in this preliminary and simple parton-level investigation, we will 
simply compare the signal and the main corresponding physical background to determine if, 
grossly, the exchanges of the KK states could give rise to a promising and possibly detectable 
signal. A more detailed Monte-Carlo study, including precise experimental effects, initial 
and final state radiation, the correct identification of the t/b states and the measurement of 
their momenta, more efficient and realistic cuts and detection efficiencies, which is beyond 
our scope here, will be needed. Nevertheless, the large significances that we will present are 
expected to remain at an interesting level after implementation of these experimental effects. 

3.2 The cross sections 

The invariant mass distributions da/dm t t of the process pp — > ti, are shown in Fig. [2] for the 
four scenarios E\ to E^, the cuts on the transverse momenta and the rapidity of the final 
i-jets given in eq. have been applied. Shown are the distributions in the case of the SM 
background, qq/gg — > ti, in the case where the KK excitation of the gluon is also exchanged, 
qq ~* 9i 9 — > ti, and in the case where all the KK excitations of the electroweak gauge 
bosons are also exchanged qq — > g,g^-\^ l \ Z ^ — > ti. As already mentioned, we have 
used a common mass for the KK gauge bosons, Mkk = 3 TeV, with the couplings given in 
Table 1 that lead to the bb,ti branching ratios and total decay widths displayed in Table 2. 

As can be seen from the figure, there is a substantial contribution of the KK excitations 
to the invariant mass distribution, in particular around the peak m t i ~ 3 TeV. At higher 
invariant masses the KK contribution becomes small, while at invariant masses lower than 
Mkk h is significant even for m t i ~ 2 TeV; only for m t i < 1 TeV the KK contribution becomes 
negligible. Outside the KK mass peak, the RS effect is mostly due to the interference between 
the excited state and SM contributions; this interference is positive below and negative above 
the peak [where the real part of the propagator of the KK state changes sign] . The dominant 
contribution compared to the SM case is by far due to the exchange of the excitation of the 
strongly interacting gluon which has the largest (QCD versus EW) couplings to the initial 
state partons. The contributions of the KK photon and KK Z boson increase the peak only 
slightly. In turn, the KK excitation of the Z' boson has a negligible impact on ti production 



12 



as it does not couple to the initial light quarks, Q'(ciight) = 0, and the parton density of the 
heavier bottom quark in the proton is small. 
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Figure 2: The invariant mass distribution of the cross section for the pp — > tt process for all 
four scenarios £1,2,3,4 defined in Table [TJ We use the CTEQ5M1 set of parton distribution 
functions and include the cuts of eq. <Q on the p^ and rj t f of the final quarks. The solid 
curve is for the SM background and the long-dashed one for the RS model with contributions 
of all the first KK excitations of the gauge bosons 7^, included; the short-dashed 
curve is for the SM case along with only exchange; the dotted curve is for the SM case 
along with only 7W exchange; the dashed-dotted curve is for the SM case along with only 
Z^ 1 ' exchange. 

The total cross sections of the pp —> ti process are displayed in Table [3] first for the SM 
background only and then in the RS model in which all contributions of the KK excitations 
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Table 3: Left: The pp — > ti cross sections [in fb] in the SM and in the RS model with the 
exchange of all the KK excitations as well as the significance of the signal for £ = 10 fb -1 
and £ = 100 fb" 1 . Right: the significance for £ = 100 fb -1 of the signal when only the 
separate contributions of the KK excitations of the gluon, photon and Z bosons are added 
to the SM contribution. These numbers are obtained after the cuts of eqs. ([5]) and ([6]) are 
applied. 

[gluon, photon and Z boson] are added; the cuts on the invariant mass, transverse momentum 
and rapidity of the t and t jets, eqs. §5§ and (jSJ), are applied. The significance of the full 
signal with a common mass, Mkk = 3 TeV, is also shown for the integrated luminosities 
£ = 10 and 100 fb" 1 . As can be seen, the significance of the excess of events in the RS 
scenarios when all KK excitations are included is large in the four cases, iS^f > 30 for a 
moderate luminosity and Sf^ > 90 for an high luminosity. 

To illustrate the impact of each KK state separately, the right-hand side of Tab. [3] shows 
the significance of the signal in the case where only one KK excitation is exchanged in the 
pp —* ti process, that is, when the mass of the two other excitations is (artificially) set to 
high values. As one might have expected, since the excess over the SM background is mainly 
due to the exchange of the KK gluon, the significance in this case, Sf 00 , is almost the same 
as when the full signal is considered, Sf^. In the case where only the first KK excitation of 
the photon or the Z boson is considered, the significance is much smaller. This is a mere 
consequence of the fact that the electroweak couplings of the j^\Z^ bosons are much 
smaller than the QCD couplings of the leading to limited production cross sections. 
The smaller rates are, however, partly compensated by the smaller total decay widths and 
one obtains in some scenarios significance at high luminosities that are large enough for the 
effects to be detectable at the LHC, iS>7oo Z ~ 5. 

The significance of the signal strongly depends on the chosen scenario which fixes the 
couplings of the KK excitations to the t, b quarks. If the couplings to top quarks are large, 
the pp — > Vkk — ► ti production rate is substantial but the total decay width is also large 
leading to a more diluted signal. The signal is even more diluted when the couplings of 
the KK excitations to b quarks is at the same time large: on the one hand, this increases 
the total decay width of the excitation and, on the other hand, it lowers the branching 
ratio into the ti final states that we are looking at. Taking the example of the state, 
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the best significance is obtained in scenario E3 in which the couplings to the b quarks are 
not too strongly enhanced (see Table [1]) so that the g^ 1 ' total decay width is the smallest, 
~ 330 GeV (see Table [2]), and the branching ratio for decays into top quarks is among 
the largest ones, BR^ 1 ) — > tt) ~ 83%. In scenario Ei, where the parameters are as in 
scenario E$ except for the Q(ct R ) and Q'(ct R ) charges which are larger, the total decay 
width of doubles, T g (X) ~ 630 GeV, while the fraction for decays into top quarks is not 
significantly affected, BR(gW — ■> it) ~ 91%, leading to a smaller significance, = 41 
versus 5f s = 52. In scenarios E 2 and E4, the total decay widths of g^ 1 ' are larger and the 
ti branching ratios smaller so that the significance of the signals is reduced compared to the 
two previous scenarios. 

The discussion for the production process pp — > bb is quite similar to that of pp — > ti 
except for the fact that the t-channel contribution to the bb — > bb subprocess has to be 
added. The smallness of the parton distribution function of the bottom quark can be partly 
compensated by the potentially larger KK gauge couplings of the b^R states [for small ct R 
values as shown in Table [1] compared to light quarks. For instance, this bb contribution 
reaches the level of ~ 10% in the SM+RS cross section in scenario E 4 . However, this 
contribution does not peak at a given invariant mass value. The invariant mass distribution 
da/dm b i for bottom quark pair production is shown in Fig. [3] for m b i between 2 and 4 TeV. 
As previously, the cuts on the transverse momenta and rapidity of the final jets given in 
eq. (jBJ) have been applied. Here, we simply show the SM background and the signal excess 
in the case where the contributions of all KK excitations are simultaneously included; again, 
this excess is largely dominated by the exchange of the KK excitation of the gluon. 

The signals are less striking than in the pp — > ti case, the main reason being due to the 
fact that the branching ratios BR(gW — > bb) are much smaller than BK(g^ — > ti), due to 
the hierarchy between the b and t couplings (see Tabled]), except in scenario E& and, to a 
lesser extent scenario E2, in which they are comparable. The cross section in the SM and 
in the RS model, as well as the significance of the signal for the two possible luminosities 
£ = 10 and 100 fb _1 , are shown in Table H] in the four scenarios when the cuts of eqs. (jSJ) 
and are applied. One can see that in all cases the significance is large enough, <S^j s > 5, 
to allow for the detection of the signal even at moderate luminosities. For example, in the 
parameter set £4, the Cb R value is smaller than for E 3 so that the KK gauge coupling to b 
is larger, leading to higher bb production cross section and significance. Comparing now E4 
to E 2 , c tR is larger which induces smaller widths for KK gauge bosons and thus a better 
significance, for same reasons as before. 

Note that when combining the pp — > ti and pp — > bb processes, one would in principle 
be able to have access to the couplings of the KK states to top and bottom quarks. 
However, it would have only a small contamination from the various overlapping electroweak 
KK resonances, since the major part of the signal is due to the contribution of the gluon 



15 




Figure 3: The invariant mass distribution of the cross section for the pp — > bb process for 
all four parameter sets -Ei, 2,3,4 defined in Table CD We use the CTEQ5M1 set of parton 
distribution functions and include the cuts of eq. d^J) on the p^ 6 and rj b 1 of the final quarks. 
The solid curve is for the SM background and the long-dashed one for the RS model with 
contributions of all the first KK excitations of the gauge bosons <7^, 7^"\ Z^ l \ Z'W included. 

excitation. As the couplings are parity violating, an additional and important information 
is provided by some polarization and forward-backward asymmetries to which we turn our 
attention now. 
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Table 4: The pp —>■ bb cross sections [in fb] in the SM and in the RS model with the exchange 
of all the KK excitations as well as the significance of the signal for £ = 10 fb -1 and £ = 100 
fb _1 ; the cuts of eqs. (jSJ) and (jSJ) have been applied. 



3.3 Polarization and forward— backward asymmetries 

Each of the KK excitations of the gauge bosons, g^\j^ and Z^ l \ has a different coupling 
to the right- and left-handed top quarks [which are themselves different from the SM ones]. 
These couplings appear in the forward-backward asymmetry as well as in the polarization 
of the produced top quarks. While the enhancement in the production rate due to a single 
KK gauge boson is proportional to the sum of squared couplings (gg™) 2 + (#q™) 2 ; the 
polarization and forward-backward asymmetries are proportional to the difference (fi'g™) 2 — 
((yfg™) 2 . Thus, a combined measurement of the cross section together with asymmetries 
would determine the couplings of the vector boson Vkk- However, since the process is 
mediated by the exchange of several KK gauge bosons with differing right- and left-handed 
couplings, it will not be possible to measure these couplings for any of the electroweak 
KK excitations. This is particularly true as the major contribution to the total rate for 
a(pp — > QQ) is coming from as the contribution from the electroweak excitations 7^, 
and Z'W is relatively small. Nevertheless, the measurement of the polarization and 
forward-backward asymmetries for top quarks, on which we will concentrate here, will be 
instrumental in establishing the presence of parity violating KK gauge bosons. 

The polarization of the produced top quarks is defined as: 

N R - Nt 

where Nr and Ni are the numbers of events with right- and left-handed helicity for the top 
quark with a given set of kinematical cuts§. The statistical error in the measurement of this 



9 We note here that even for extra- dimensional models in which the KK excitations have the same cou- 
plings as their SM counterparts, the Z^ x ' state will always have parity violating couplings and hence, the 
produced top quarks will be polarized. However, in this case, following the structure of the SM, the left 
chiral top quark has larger coupling to the excitation, leading to a negative polarization. On the other 
hand, in the RS model that we consider here, the right chiral top quarks have larger couplings to the KK 
gauge bosons, leading to a positive polarization. 
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polarization, in terms of the rate a and the LHC luminosity £, is given by 

1 r, -tt 1 



AR 



p2 



The polarization of the top quark is shown in Fig. [4] in the case of the SM and for the RS 
scenario E\ as a function of the invariant mass m t f, again the cuts of eqs. (jH]) have been 
applied and the contributions of all virtual KK states has been included. 
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Figure 4: The top quark polarization as a function of the invariant mass m t i in the reaction 
pp — > ti in the SM (solid) and in the RS model (dashed) for the set E\ of parameters. 

The polarization is a parity odd quantity and can assume a non-zero value only in the 
presence of parity violating interactions. In the SM case, the only source of parity violation is 
the contribution of the Z boson, which leads to a small negative polarization of order ~ 10 -3 . 
The dominant contribution for m t i near Mkk is due to which has a larger coupling to 
tn than to ti in the chosen RS scenarios; this leads to a large polarization roughly of the 
size 



(^ KK ) 2 - G£ KK ) 2 



(9 



Vkk )2 + {g V r)2 



(9) 



coming from the qq fusion channel. However, there is a dilution of this polarization due 
to the parity-conserving SM production of top pairs through gg fusion and qq annihilation 
with gluon exchange. For instance, in the case of scenario E\, one has for the first gluon 
excitation gV-\ G g _ + = 0.86, while the degree of polarization, P t = 0.505, is diluted by the 
SM QCD processes. Similar results are obtained in the other scenarios and one has: Pt — 
0.37,0.52,0.38 in scenarios E2,E^,E 4: , respectively. Furthermore, there is some subleading 
contribution from the and states which is, for instance, visible as a small "dip" just 
before the peak in the m t i distribution of the polarization P t in Fig. |H 
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The polarization of the top quark is not a direct observable. Nevertheless, it is reflected 
for instance in the angular distribution of the lepton coming from the decaying top quark, 
t — > bW — > blv with £ = e, fi. In the rest frame of the t-quark, the leptons issued from these 
decays are isotropically distributed for unpolarized top quarks. For positive P t , the lepton 
distribution is peaked in the direction of the "would be" boost or the direction of quantization 
axis, and for negatively polarized top quarks, the peak is in the opposite direction. In the 
laboratory frame, the decay products of the fast moving top quark are collimated in the 
forward direction due to the boost. Thus, for the positively polarized top quarks, there will 
be additional focusing of the leptons in the direction of the top quark momenta. Accordingly, 
there is a de-focusing of the lepton distribution for the negatively polarized top quarks. Thus, 
the simplest quantity to look at is the azimuthal distribution (or the focusing) of the leptons 
with respect to the top production plane [35]. We thus define the following asymmetry in 
the laboratory frame: 

A _ a(cos(f)£ > 0) - ff(cOS0£ < 0) 
<r(cos (f>£ > 0) + a(cos (f)£ < 0) ' 
where <pi is the azimuthal angle of the decay leptons with respect to the t-quark production 
plane, or with respect to the transverse momentum of the top quark. Again, the statistical 
error in the measurement of the asymmetry and the corresponding significance is given by 

i i aRS+SM _ aSM 

respectively. The values of the asymmetries in the various RS scenarios and the significance 
in their measurements are shown in the right-hand side of Table |5j 
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Figure 5: The lepton asymmetry distribution versus the m t i invariant mass for the process 
pp — > ti in SM and in the RS scenario E\. 
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Since we are dealing with heavy KK bosons, the top quarks are highly boosted in the 
center of mass frame, which leads to highly collimated decay products even for unpolarized 
top quarks. This explains the large value of the asymmetry, ~ 0.96, for the SM in the 
case of E\ cuts for example; see Table [5J A modification of the top polarization changes the 
collimation of the decay products and, thus, affects this SM asymmetry. For instance, again 
in scenario Ex, one expects a large and positive polarization for the top quarks, which leads 
to a slightly larger asymmetry value, Ag ~ 0.98. The significance S calculated according to 
eq. (fTTI) . indicates that this asymmetry should be observable at the LHC but only for a high 
luminosity run in a post-discovery analysis [the discovery being clearly possible at a low 
luminosity] as shown in Table [5j Therefore, the associated distribution displayed in Fig. [5] 
for the parameter set Ex, which exhibits a specific shape, should help in identifying the RS 
scenario. In particular, the fact that this Ai asymmetry is enhanced by the RS contribution 
proves that the exchanged KK gauge bosons couple effectively more to the tu than to the ti 
state. 
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Table 5: Left: The polarization and forward-backward asymmetries, An and A l FB , for the 
process pp — > ti in the SM and in the RS model with the exchange of all the KK excitations 
as well as the significance of their measurements for £ = 10 fb _1 and £ = 100 fb _1 . 

Let us now turn our attention to the forward-backward asymmetry. The s-channel dia- 
grams exchanging gauge bosons with parity violating couplings lead to a forward-backward 
asymmetry in the top quark pair production in the center of mass frame with respect to the 
quark direction. However, since at the LHC there are two identical protons colliding, there 
is no simple forward-backward asymmetry in the laboratory frame due to the symmetric 
distribution of the initial state quarks and anti-quarks. But, since the proton is mainly 
composed of quarks and with only a small proportion of anti-quarks in the sea, the fusing 
qq pairs are highly boosted in the laboratory frame, mainly in the direction of the incoming 
quarks. Thus, one can construct a kind of forward-backward asymmetry with respect to 
the direction of the boost in the center of mass frame. In the laboratory frame, we first 
arbitrarily label the proton beams as "1" and "2", and then define a quantity 

C=(^^)cosC (12) 

\Xx + X 2 J 
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Figure 6: The forward-backward asymmetry distribution versus the invariant mass m t i for 
the reaction pp —>■ ti in the SM and in the RS scenario Ei. 



where Xi are the momenta fractions of the colliding partons and #] ab the t-quark polar angle 
with respect to the beam "1"; the quantity in the brackets is the boost of the center of mass 
frame in the laboratory frame. With respect to this quantity we define a forward-backward 
asymmetry with respect to the direction of boost: 



a(C > 0) - a(C < 0) 



Afb ~ a(C> 0) + a(C < 0) ' (13) 

This quantity is closely related to the forward-backward asymmetry in the center of mass 
frame, with respect to the quark direction, up to some smearing due to the boost of the 
center of mass frame and possible misidentification of a q as a q for a faster moving q. The 
statistical error in the measurement of this asymmetry is given by 



A^ B = ^=Jl-(^ B )2. (14) 

We should note that the above asymmetry is not a pure probe of parity violation, i.e. it 
can be non-zero and positive even for parity-conserving processes. The reason is the boost 
of the center of mass frame with respect to the quark direction, which leads to focusing of 
particles in the forward direction. This explains the large value of A\. B for the SM as shown 
in Fig. [6] by a solid line. Additional sources of a forward-backward asymmetry in the center 
of mass frame change the value of A^ B , which is shown in Fig. [6] by a dashed line for the 
RS scenario E\ where there is a significant contribution from parity violating couplings of 
the g^ 1 ' excitation. Once more, there is some finite contribution from the electroweak KK 
modes which appears as a "nipple" peak in the m t i distribution of Ap B , Fig. O 
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The obtained values of Ap B and their significance given in Table [5] for all scenarios, 
shows that it is potentially visible at the LHC even at low luminosity with Si™ > 5. 
Such significant shifts in the asymmetry with respect to the SM expectation would strongly 
indicate parity violation in the top couplings to KK gauge bosons. Indeed, these typical 
asymmetry deviations cannot be entirely explained by interferences between hypothetical 
parity-conserving bosons and the parity violating SM Z boson. Moreover, the profile of 
the Ap B distribution in Fig. [6] is characteristic of the exchange of several KK gauge bosons. 
The enhancement of Ap B originates from the fact that the effective couplings of KK gauge 
bosons, and mainly the KK gluon g^\ are larger for the tji than for tjj. 

Note that we have also calculated the asymmetry Ap B for the pp — > bb production process, 
but we do not present the corresponding results as the significance is rather low in all the 
considered scenarios. Furthermore, we will not discuss the polarization of the produced 
bottom quarks as it will not be experimentally measurable. 

4. The higher order processes 
4.1 The gluon— gluon fusion mechanism 

The higher order gluon-gluon fusion contribution to the heavy quark pair production at 
LHC, via KK gauge boson exchange, should be favored by the large Vkk couplings to heavy 
quarks. Such a reaction occurs through a loop involving mainly the heavy top and bottom 
quarks and a Vkk exchanged in the s-channel, as shown in Fig. [3(a). Indeed, the main 
reaction is via Vkk — 9^ which receives no contributions from the light quarks in the loop 
as those have quasi identical couplings for the left and right chirality (fixed by a common 
Q^(cught) value as explained at the end of Section 2.2) which makes the final amplitude 
vanishing. This reaction represents the dominant two-body production mechanism for KK 
excitations which do not couple to light quarks. 




Figure 7: The Feynman diagram for QQ (Q = b,t) production, via Vkk exchange, at the 
LHC through the quark loop induced gluon-gluon fusion process (a) and the counter-term 
with the Stiickelberg mixing that regulates the gauge anomaly of the ggVKK vertex (b). 

The effective one-loop vertex gik^gik^jVKKik 1 ^) , where k", k%, k% denote the respective 
momenta (k\ and k 2 being taken as incoming with respect to the flow in the loop), is given 
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in momentum space by, 

Tf p = [(Axfa, k 2 ) - B 2 (k u fc 2 ))e M ^(^ - kl) + Bl ^ 2) Kklik^r - Ke, vaT ) 

(15) 

with, 

t^ k = glTrWXM [g v qL Q ( '\c qL ) - g v qR Q { '\c qR )} , (16) 
/ 

g s being the strong interaction coupling constant, [i — 1, . . . , 8] the Gell-Mann matrices 
(only two such matrices must be taken in the case of colorless KK excitations: Vkk 7^ <7 ), 
e^pa the purely antisymmetric tensor and Ql/r the quarks running in the loop. Finally, the 
A 1 (ki, k 2 ) function, entering eq. fTTol) . represents the usual amplitude a priori divergent. The 
finite functions -61,2(^1,^2) are defined later. 

Indeed, the amplitude eq. fTl5|) contains an anomaly in the third current. As a matter of 
fact, only two of the three Ward identities that the vertex must obey are satisfied^!: 

"a 1 pup — u 5 ^2 L pup — u > 

- K^t P = ~( k i + k *) T t P = -t tJk 2(Mh, h) - B 2 (h, k 2 )) e vpar k° 2 k\. (17) 
The first two relations allow to define the ambiguous amplitude ^4i(fci, k 2 ) in terms of finite 
functions: 

A x {k u k 2 ) - B 2 (k u k 2 ) - El^hM. = 0. (18) 

However, the ggVxx vertex receives another contribution from the exchange of the gauge 
field fifth component V5, as drawn in Fig. 0(b). There, the ggV$ coupling originates from the 
so-called Chern-Simons term in the action (see Ref. [38] for the case of warped orbifolds) 
which can be written in terms of the gauge covariant field strengths as [39,40]: 

Scs = J d i xdyp(y)e MNp Q R Tr[A M + iA M A N A P F QR - ^A M A N A P A Q A R j , (19) 

where the Roman letter indices M, N. . . run over all dimensions. While the mixing between 
d^A^ and Apf* (the Greek letter index jj, is running over the first four dimensions only), 
appearing in the diagram of Fig. [3(b), and proportional to the gauge KK mass, comes from 
the Stiickelberg term; see for instance Refs. [39,41]. Following Ref. [41], one finds that the 
diagram of Fig. [3(b) gives rise to a vertex contribution of the form, 



^u P \cs = 2F k A x {k Xi h) ** e vpirr kZkZ. (20) 
The whole amplitude is then free from any gauge anomaly as one has now, 



10 See Ref. [36,37] for the generic computations of gauge anomalies in the context of S 1 /Z2 orbifold models. 
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- fc£(rg* + Tf p \cs) = 2t^B 2 (h, k 2 )e up(TT klkl. 



(21) 



where B 2 is proportional to the mass of fermions running in the loop. Therefore, as expected, 
there is a mechanism responsible for the cancellation of the gauge anomaly. 

The B functions entering above equations read as, 



B 2 (k u k 2 ) 



3(2vr)< 



■1-2 



3(2tt) 



dz 



dz 



dx 



x(x + z 



l-z 



dx 



(m 2 f / (2ki.k 2 )) — xz' 
(1 — z)m 2 . 
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m 2 — {2k\.k 2 )xz ' 



(22) 



In conclusion, both the vertex contributions eq. (JT51) and eq. (|20|) have to be taken into 
account in the calculation of the quark contribution to the ggV^K vertex. Note that the 
correction eq. (120]) vanishes in the on-shell regime limit for Vkk where ^363^ = 0, €3 being 
its polarization vector. This is consistent with Yang's theorem according to which the entire 
production cross section vanishes if the two initial zero-mode gluons as well as the produced 
KK gauge boson are simultaneously on-shell. This is illustrated by the m t i invariant mass 
distribution that we will discuss now. 
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le-08 



le-10 



le-12 



gg -> V KK -> 1 ' 
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Figure 8: The m t i distribution of the cross-section corresponding to the reaction shown in 
Fig- f or ^kk = g f or the E 2 choice of parameters. The whole SM distribution is also 
shown for comparison. 

The m t t distribution for the above said process is shown in Fig. [HI along with that for 
the SM background, for the excitation g^ and the E 2 choice of RS parameters. The dip in 
the distribution near the mass m t t = ttikk is due to the vanishing coupling for on-shell Vkk 
bosons with a pair of gluons. The shape of the distribution depends upon the total decay 
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width of the Vkk- However, the rates for the signals are several orders of magnitude smaller 
than the SM background. The cross sections are even smaller for the KK excitations of the 
electroweak gauge bosons. One can then conclude that the gluon-gluon fusion mechanism 
for the production of KK excitations will not be relevant at the LHC. 

4.2 Associated production with heavy quarks 

In this section, we briefly discuss the associated production of the KK excitations of the 
gauge bosons with heavy quarks 

gg/qq -> Q'Q' V K k -> Q'Q' QQ (23) 
gb -> b Vkk ^b QQ (24) 

where q stands for the light quarks present in the proton and Q/Q' stand for the final state 
heavy t and/or b quarks. Some generic Feynman diagrams are shown in Fig. [9j In the first 
case, a pair of b or t quarks is produced mainly in the gg fusion subprocess with a small 
contribution from qq annihilation, followed by the emission of a KK gauge boson from one 
of the heavy quark lines, while in the second case a KK gauge gauge boson is emitted from 
the 6-quark line in gb fusion with the initial 6-quark taken from the proton sea. In both 
cases the produced KK gauge boson decays predominantly into heavy quark pairs, leading 
to topologies with multi b and/or t final states. 

( a ) ^^Q' (b) 
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Vkk ,, Q b 
\A/WV<r 

Q 9 



Vkk 



Q' 



Figure 9: Typical Feynman diagrams for associated Vkk production with Q',Q = t,b quarks 
at the LHC: the four-body gg — > QQQ'Q' (a) and the three-body gb — > bQQ (b) processes. 

In the 2 — > 4 body reaction of eq. (1231) . since the SM production of quark pairs is 
dominated by the gg fusion mechanism, the largest contribution to associated production of 
KK gauge bosons with heavy quarks comes also from the same channel. After radiation from 
the heavy quark line, Vkk can either decay into a heavy quark pair of the same flavour as it 
was produced in association with, or of the other heavy flavour. To avoid the combinatorial 
background, we choose to look at ti + bb final states which originate from the two channels 
pp — > bbVKK with Vkk — > ti and pp — > UVkk with Vkk — > bb. Since the gg — > bb cross section 
is much larger than the pp — > ti cross section and that the ti branching ratio of Vkk is in 
general larger than the bb branching ratio, the final ti bb sample from the signal is dominantly 
originating from the subprocess pp — * &6Vkk ~ * bb ti. 
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As for the kinematics of this production channel, the KK gauge boson is produced almost 
at rest owing to its large mass and hence decays into top quarks with a wide range of 
transverse momenta with an excess of events with large pt- On the other hand, the b quarks 
produced in the hard process of gg fusion dominantly have small transverse momenta. The 
picture is reversed for the second channel pp — > UVkk tibb which, as already mentioned, 
gives a smaller contribution to the signal cross section. For the QCD background that we 
have considered, pp — > tibb, and that we have calculated using the code CompHEP [42], the 
dominant contribution comes from the subprocesses gg/qq — * tt production followed by the 
emission of a virtual gluon splitting into a bb pair. To reduce this QCD background without 
significantly affecting the signal, we impose the following set of kinematical cuts 

p¥ > 300 GeV, pj!' > 100 GeV, \ij q> q\ < 2 . (25) 

We have used large cuts on the top quarks transverse momenta to reduce the background 
as much as possible; one can further optimize these cuts to improve the significance of the 
signal, but as the number of events will turn out to be rather small, we do not perform that 
analysis here. Additionally, we impose an opening angle cut 9 b i > 60° which reduces the 
gluon splitting into bb in the background by more than an order of magnitude and does not 
affect the signal much. 

The cross-sections for tibb production are shown in Table [6] in all four RS scenarios E\ 
to E\. The numbers for the RS model correspond to the signal only and do not include the 
background events or the interference with the background amplitudes [which should occur 
in the case where the KK excitation of the gluon is produced]. The rather low cross sections 
for signal events, compared to a SM background of 0.4 fb, indicate that even with a 

high luminosity of C = 100 fb -1 , one will not be able to reach a significance of 5a. The best 
significance, ~ 4a, is obtained in the case of scenario E 2 . Hence, no discovery is possible 
with the tibb channel of associated production, if a reasonable luminosity is assumed. We 
expect the trend for the other topologies to be similar. Note that here, we considered only 
the production of the KK excitation of the gluon; the significance for the production of the 
KK excitations of the electroweak gauge bosons [and in particular of the Z'^ which cannot 
be produced in the Drell-Yan processes discussed in section 3] is even smaller. 

Next we turn to the associated production of the KK excitations with a 6-quark in gb 
fusion. Though the density of b/b quarks in the proton is small, the large coupling of the 
6-quark with the KK gluon for instance could partially compensate for it. Looking at the 
reaction gb — > bg^ 1 ' — > bti, where b stands for both the b and the anti-6 quark, we use the 
same kinematical cuts as those introduced in eq. 025p . In fact, because now we are dealing 
with a 2 — * 3 production process, the signal cross sections are expected to be one order of 
magnitude larger than that of the 2 — > 4 process discussed previously. Here again, the b quark 
produced in the hard process has low transverse momentum, while the top quarks can have 
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a Rb (pp — >■ ttbb) 


(J / u 


Ottbb 
°100 


E 1 


0.06 


0.13 


0.8 


E 2 


0.26 


0.58 


3.9 


E 3 


0.04 


0.08 


0.6 


£4 


0.16 


0.35 


2.3 



Table 6: The signal cross section [fb], the signal to background ratio and the signal statistical 
significance for C = 100 fb -1 for the four-body process pp — > ttbb in the RS scenarios £1,2,3,4 
after the cuts discussed in the text are applied. 

large transverse momenta in the signal events. The irreducible QCD background bg — > bti, 
that we calculate again using CompHEP [42] , is also more than one order of magnitude larger 
compared to the previous process, cx SM ~ 9 fb. 

The signal production cross sections for a top quark pair and a 6-type jet with the 
kinematical cuts of eq. (125]) is shown in of Table [7] for the pure RS signal in the four selected 
scenarios #1. 4- Again the points E 2 and £4 have large signal cross sections owing to the 
large coupling of the b quarks to the KK gluon. For the other two points, the couplings of 
b quark are small and, hence, lower production rates of the KK gluon are obtained. With 
an integrated luminosity of C = 100 fb -1 , one obtains a significance which is larger than 8 
for scenarios E 2 and £4, while it is about 3 or less for the other two scenarios. We again 
have considered only the associated production of a KK gluon and not accounted for the 
interference between the RS signal and the background. 





a RS {pp -> ttb/ttb) 




Qttb 
°100 


£1 


0.91 


0.10 


3.0 


E 2 


4.12 


0.47 


13.8 


£3 


0.61 


0.07 


2.0 


£4 


2.50 


0.28 


8.4 



Table 7: The signal cross section [fb], the signal to background ratio and the signal statistical 
significance for £ = 100 fb" 1 for the three-body process gb — * tib/tib in the four RS scenarios 
£1,2,3,4 after the cuts discussed in the text are applied. 

Thus, at least in the 3-body production process gb — > bti, the cross section in some 
RS scenarios can be significantly larger than the QCD background cross section. However, 
to reach a signal significance which is important, large integrated luminosities, L > 100 
fb" 1 , are needed. In this case, the top and bottom quark jets cannot be identified with an 
excellent efficiency and more background processes with potentially much larger rates need 
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to be considered. Detailed experimental analyzes need thus to be performed in order to 
assess the viability of this signal. 

5. Conclusions 

In the framework of the Randall-Sundrum extra-dimensional model with SM fields in the 
bulk, we have studied the production of the KK excitations of gauge bosons at LHC which 
then dominantly decay into heavy top and bottom quark pairs. For illustration, we have 
considered a specific version of the model in which the SM gauge group is enhanced to a 
left-right symmetry and concentrated on quark geometrical localizations and gauge quantum 
numbers that allow to solve the LEP anomaly on the forward-backward asymmetry A h FB . We 
have selected some characteristic points of the parameter space of this model and assumed 
masses Mkk ~ 3 TeV for the KK excitations of the gluon and the electroweak gauge bosons 
as dictated by constraints from high-precision electroweak data. 

We have shown that the contribution of the Drell-Yan process qq — > Vkk ~~ * ti to the 
pp — > qq/gg — > ti cross section, in which we have taken into account the total width of 
the excitation as well as the interference between the signal and SM the background, can 
be substantial and would allow for the detection of the gluon KK excitation with a high 
statistical significance; the signal significance is smaller for the excitations of the electroweak 
gauge bosons as a result of the smaller couplings. Besides the invariant mass distributions 
and the sizeable total widths of the KK resonances, the polarization of the top quark and the 
forward-backward asymmetry, would allow to characterize the signal and to probe the chiral 
structure of the fermion couplings of the KK excitations. In the case of the qq — > Vkk — > bb 
process, a large signal significance compared to the SM background is also obtained. 

We have also calculated the cross sections for the higher order processes in which the KK 
excitations couple only to the heavy top and bottom quarks and compared them to their 
corresponding irreducible SM backgrounds. We have first studied the gluon-gluon fusion 
mechanism, gg — > Vkk — > ti, bb, which is induced by a heavy quark loop and in which the 
anomalous ggV^K vertex has to be regulated via the Stiickelberg mixing term. We have 
then analyzed the four-body reactions pp — > itbb, titi and bbbb as well as the three-body 
reactions gb — > bti and bbb, in which the KK excitations are radiated from the heavy quark 
lines. The cross sections for these higher order processes at the LHC, except potentially for 
the bg — > g^b process, turn out to be too small compared to the SM background, to allow 
for a detection of heavy KK excitations with Mkk ^ 3 TeV. 

In our parton-level analysis, we took into account only the irreducible SM QCD back- 
ground and did not attempt to include experimental effects such as detection efficiencies, 
6-quark tagging, reducible light jet backgrounds etc.. Only refined and realistic Monte-Carlo 
analyses, which take into account all these effects, would allow to assess the viability of the 
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KK gauge boson signals. These experimental analyses are currently being performed by 
some members of the ATLAS and CMS collaborations [43] 
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